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(57) Abstract 

A device for recording hand-written infor- 
mation in the form of characters, symbols, graphs, 
drawings, calligraphy and similar hand-written in- 
formation defined by a hand movement, comprises 
recording means (3) which are adapted to be moved 
by a hand which carries out the hand movement 
and to record a plurality of images with partially 
overlapping contents while the recording means are 
being moved. The device further comprises im- 
age-processing means (4) which are adapted to de- 
termine the relative position of the images with the 
aid of the partially overlapping contents for provid- 
ing a description in digital format of how the unit 
has been moved and, in this way, a digital represen- 
tation of the hand-written representation. A method 
of recording hand-written information is also dis- 
closed. 
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DEVICE AND METHOD FOR RECORDING HAND-WRITTEN 

INFORMATION 

Field of the Invention 

The present invention relates to a device for 
recording hand-written in the form of characters, sym- 
bols, graphs, calligraphy and similar hand-written infor- 
mation defined by a hand movement, comprising recording 
means which are adapted to be moved by a hand which car- 
ries out the hand movement and which is adapted to record 
a plurality of images with partially overlapping contents 
while the recording means are being moved. The invention 
also relates to a method for recording hand-written 
information . 

Background of the Invention 

Today, practically all information processing takes 
place in computers. The information processed often con- 
sists of text which is input to the computer by the 
intermediary of a keyboard. If the text which is to be 
input has already been written on a sheet of paper, a 
scanner is sometimes used for the inputting. 

Sometimes there is a need for inputting hand-writ- 
ten or other hand-generated information to a computer. 
An example of this is when one wishes to input a person's 
signature. Presently, this can be carried out by scanning 
the signature or by the person writing his signature with 
the aid of a mouse in a drawing program. 

Certain smaller computers, so-called pocket compu- 
ters, have an interface enabling inputting of hand-writ- 
ten text with the aid of a pen. More specifically, such 
computers have a touch- sensitive screen, upon which the 
user writes with a pen. The computer records the movement 
of the pen across the screen. ICR software (ICR = Intel- 
ligent Character Recognition) identifies the characters 
represented by the recorded movement and stores them in 
character-coded format in the computer. A drawback of 
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this technique is that it requires access to a touch-sen- 
sitive screen . 

Moreover, by way of JP 032 65023, it is known to 
input hand-written text to a computer with the aid of a 
5 pen whose tip is provided with a ball. When one "writes" 
with the pen on a substrate, the ball rolls. With the aid 
of information about how much and in which direction the 
ball is moving, the computer can determine how the pen is 
being moved. A drawback of this device and other devices 

10 based on moving mechanical components is that the moving 
component makes the device more difficult to manufacture 
and less durable. 

Furthermore, EP 0 629 759 discloses a device for 
storing hand-written text in the form of an image. This 

15 device has no moving parts. It comprises a pen tip and a 
CCD area sensor which is used to reproduce that written 
with the pen tip. In one embodiment, the device has the 
pen tip at a first end and the CCD sensor at a second 
end. In this case, the user first writes with the pen tip 

2 0 and then turns the device and activates the CCD sensor to 
reproduce what has already been written. In another embo- 
diment, the pen tip and the CCD sensor are located at the 
same end of the device. In this case, the CCD sensor con- 
tinuously reproduces what is being written by recording 

25 images. The images which have partially overlapping con- 
tents are put together to a composite image of what has 
been written. When the written information is to be 
shown, the composite image is shown. 
S umma ry of the I nvent i on 

30 An object of the present invention is to provide an 

alternative method and an alternative device for record- 
ing hand- written information in the form of characters, 
symbols, graphs, calligraphy and similar hand-written 
information defined by a hand movement. 

35 This object is achieved by a device according to 

claim 1 and a method according to claim 18 . Preferred 
embodiments are stated in the subclaims. 



• 
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Thus, according to a first aspect, the invention 
relates to a device for recording hand-written informa- 
tion in the form of characters, symbols, graphs, draw- 
ings, calligraphy and similar hand-written information 
5 defined by a hand movement. The device comprises record- 
ing means adapted to be moved by a hand which carries out 
the hand movement and to record a plurality of images 
with partially overlapping contents while the recording 
means are being moved. The device further comprises 

10 image-processing means which are adapted to determine the 
relative position of the images with the aid of the par- 
tially overlapping contents for providing a description 
in digital format of how the recording means have been 
moved and, in this way, a digital representation of the 

15 hand-written information. 

Accordingly, the device is based on the idea of 
using images. However, the images are not used like in 
prior art to reproduce the hand-written information but 
are instead used to determine how the recording means 

2 0 are moved when a user performs the hand movement, e.g. 

"writes" or "draws" something. The device thus need not 
store images of the hand-written information but it is .in- 
sufficient to store information about the movement. This 
also means that hand-written information can be input to 

25 the computer without any information simultaneously being 
"written" with ink or some colorant from a pen tip on a 
writing surface. The information can be written direct- 
ly in the air if only the recording means are directed 
at a surface which gives the images contents making it 

30 possible to determine how the images overlap. It goes 

without saying that the device can also be provided with 
a pen tip,- and "colorant -based" writing can occur simul- 
taneously with the electronic recording. In this case, 
however, the colorant -based writing need not occur with- 

35 in the field of vision of the recording means. When the 
hand-written information is to be shown after recording, 



WO 99/60467 PCT/SE99/00717 



this is carried out on the basis of the stored descrip- 
tion of how the recording means have been moved. 

Thus, the device carries out a digitisation of the 
hand movement so that a computer can process the informa- 
5 tion represented by the hand movement. In this context, 

it should be pointed out that the movement of the record- 
ing means is represented by the projection of the end of 
the recording means upon the surface at which the record- 
ing means is directed. 

10 The image-processing means are preferably implement- 

ed with the aid of a suitably programmed processor. It 
can also be implemented entirely in hardware or in some 
combination of hardware and software. 

In an advantageous embodiment, the device is adapted 

15 to store said description in digital format. It may then, 
for instance, show the recorded hand-written information 
by means of the description. Alternatively, the descrip- 
tion can be forwarded to, for instance, a personal compu- 
ter where showing can occur. 

2 0 A major advantage of the device is that the image 

recording function can be used for other purposes as 
well, thus making it possible to provide a device with 
several different fields of application. For example, 
the image recording function can be used for inputting 

2 5 text and images which are already defined on some form 
of information carrier by imaging the text and/or the 
images with the aid of the sensor. This gives the user 
access to a completely new tool enabling him to work 
more efficiently. With this single tool, the user can 

30 thus record text and image information from different 

sources and supplement it with hand-written information. 
In this way, the device can become an important tool for 
students, office staff, and other individuals whose work 
involves information processing. 

35 Suitably, the description comprises a plurality of 

movement vectors each indicating how the unit has been 
moved between the recording of two images. The movement 



WO 99/60467 



PCT/SE99/00717 



5 

vectors can be described with the aid of the coordinates 
of a certain point in the first image and the coordinates 
of the same point in the second image expressed in some 
suitable coordinate system. The movement vectors consti- 
tute a memory- saving way of storing the description of 
how the recording unit has been moved . 

In some applications it may be advantageous for the 
computer to know how the recording unit has been moved 
during the hand movement. This may, for example, be the 
case if one wishes to input calligraphy or other infor- 
mation corresponding to lines which are not of uniform 
thickness. For this purpose, the description may include 
turning indications, each indicating how the recording 
unit has been turned between the recording of two images. 

Furthermore, in one embodiment, the device is adapt- 
ed to determine the speed at which the recording unit has 
been moved between the recording of two images. In this 
embodiment, the device can thus determine the speed in 
different parts of the path of movement defined by the 
hand movement. This may be interesting if, for example*-, 
one wishes to check the authenticity of a signature, for 
which purpose the device may further be adapted to com^ 
pare the speed thus determined with pre-recorded speed 
data in order to check that the signatory really is the 
5 same person who signed the earlier signature, from which 
the recorded speed data was obtained. 

As mentioned by way of introduction, the information 
one wishes to process in a computer often consists of 
text, i.e. various types of characters. For this reason, 
0 the device is advantageously adapted to identify the 
characters with the aid of the description in digital 
format of how the recording unit has been moved and to 
store them in character-coded format . ICR software is 
advantageously used for this purpose. An advantage of 
5 storing the inputted information in character-coded 

format in the device is that this requires less memory 
space . 
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Advantageously, the device has a light-sensitive 
sensor means with a two-dimensional sensor surface for 
recording the images. In this context, a two-dimensional 
sensor surface refers to the fact that the sensor surface 
must be able to image a surface with a matrix of pixels 
so that images with overlapping contents can be recorded. 
A CCD sensor and a CMOS sensor are examples of suitable 
sensors . 

The determination of the relative position of the 
images should be carried out both horizontally and ver- 
tically in order to enable the inputting of hand-written 
information defined by arbitrary hand movements. 

While the recording unit is being moved, it is 
directed at a surface which is imaged with the aid of 
the images. The unit can be passed over the surface in 
contact with the same, in which case the hand movement 
is carried out in the same way as if one were writing or 
drawing on the surface with a pen. As an alternative, it 
can be held at a distance from the surface, which is thus 
not required to be an even surface but rather can have 
any kind of topography, in which case the hand movement 
is carried out in the same way as if one were writing or 
drawing in the air. The purpose in both cases is that the 
recording unit shall continuously record images of what 
is located within its field of vision along its path of 
movement . 

In order to make it easier for the user to "see" 
what he is writing or drawing by means of the recording 
unit, the device preferably comprises tracing means for 
indicating on the surface how the unit is being moved. 
The tracing means can, of course, comprise a pen func- 
tion, but, preferably, they should leave no permanent 
marks on the substrate at which they are directed. For 
example, they can comprise an illumination means adapted 
to project light upon the surface. 

In a preferred embodiment, the recording means and 
the image -processing means are arranged in a common cas- 
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ing, which is adapted to be moved by the hand making the 
hand movement. It then becomes a tool which is easy for 
the user to carry along and which, consequently, is easy 
to use in all types of situations. Of course, the record- 
5 ed, hand-written information is forwarded from the device 
to, for instance, a stationary computer. 

In an alternative embodiment, the recording means 
can be arranged in a first casing and the image-process- 
ing means in a second casing, such as a stationary compu- 

10 ter, to which the recording means are connected. 

The advantage of the first -mentioned alternative is 
the fact that smaller amounts of data need be transferred 
from the device to the computer.- 

In addition, in a particularly preferred embodiment, 

15 the device is adjustable to an operational mode in which 
it is adapted to record predefined information, especial- 
ly text, which is located on an information carrier by 
imaging the information with the aid of a plurality of 
images with partially overlapping contents. In this embo- 

20 diment, the capability of the device to record images is 
utilised in two ways, something which a user obviously 
finds attractive since he is not obliged to use two dif- 
ferent tools with different technical solutions for these 
functions. 

25 Moreover, the device is advantageously adjustable 

to a further operational mode in which it is adapted to 
image an object located at a distance from the device. In 
this operational mode, the device thus has the function 
of a camera. This operational mode may require the device 

3 0 to be equipped with an adjustable lens system which per- 
mits sharp imaging also at longer distances. 

In addition, the device can advantageously be pro- 
vided with a transceiver for wireless communication with 
an external unit. In this way, information can be trans- 

3 5 f erred between the device and, for example, an external 
computer. The transceiver can be an IR transceiver, a 



WO 99/60467 



PCT/SE99/00717 



8 

mobile radio transceiver, or some other suitable trans- 
ceiver . 

According to a second aspect of the invention, it 
relates to a method for recording hand-written informa- 
5 tion in the form of characters, symbols, graphs, draw- 
ings, calligraphy and similar hand-written information 
defined by a hand movement, comprising the steps of mov- 
ing a device with a hand which carries out the hand move- 
ment; recording a plurality of images with overlapping 

10 contents while the device is being moved; and determining 
the relative position of the images with the aid of the 
partially overlapping contents for providing a descrip- 
tion in digital format of how the device has been moved 
and, in this way, a digital representation of the hand- 

15 written information. The method has the same advantages 
as those described above with respect to the device. 

According to a third aspect of the invention, it 
relates to a method for determining the position of a 
device which is adapted to record a plurality of images 

2 0 while being moved, the images being recorded with par- 
tially overlapping contents which are used to determine 
the position of the device. This aspect of the invention 
can, for example, be used for solving the problems asso- 
ciated with determining the position of three-dimensional 

25 mice. A three-dimensional mouse is a control device with 
at least six degrees of freedom. Presently, accelero- 
meters are used for determining how the three-dimensional 
mouse is moved. The drawback of these accelerometers is 
that they are only capable of determining relative posi- 

30 tions. Consequently, they are unable to determine when 
the control device has been moved in such- a way that it 
has returned to its original position. If, instead, a 
three-dimensional mouse is equipped with one or more 
devices with the above -described structure, each device 

35 can be used for determining the translat ional position 
along and the rotational position about an axis by 
recording images with partially overlapping contents. By 
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comparing each image with the image in the original posi- 
tion, it can be determined when the device returns to the 
original position. Moreover, by determining the relative 
position of the images and with knowledge of the image 
5 recording frequency, it is possible to determine the 

speed of the movement, the distance and the direction of 
the movement, and thus the current position. 
Brief Description of the Drawings 

The present invention will now be described by way 
10 of an example showing how the invention can be implement- 
ed, with reference to the accompanying drawings, in which 
Fig. 1 schematically shows an embodiment of a device 
according to the invention; 

Fig. 2 is a block diagram of the electronic cir- 
15 cuitry in an embodiment of a device according to the 
invention; 

Fig. 3 is a flowchart showing the functioning of 
the device; 

Fig. 4 is a schematic illustration showing how a 
2 0 surface is imaged in connection with the inputting of 
hand- writ ten information; 

Fig. 5 illustrates how the inputted information can 
be shown on a display; 

Fig. 6 is a flowchart illustrating how the device 

2 5 is used in a scanner mode; and 

Figs 7a-7e schematically show how text is recorded 
in the scanner mode. 

Description of - a Preferred Embodiment 

In the embodiment of the device according to the 

3 0 invention shown in Fig. 1, it comprises a casing 1 hav- 

ing approximately the same shape as a conventional high- 
lighter pen. One short side of the casing has a window 2, 
which is intended to abut against or be held at a dis- 
tance from a surface when information is to be input to 
35 a computer with the aid of the device. The window 2 is 
somewhat recessed in the casing in order not to wear 
against the paper. 
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The casing 1 essentially contains an optics part 3, 
an electronic circuitry part 4, into which information is 
fed, and a power supply 5. 

The optics part 3 is used for a recording images 
5 and thus is an example of how the recording means can be 
implemented. It comprises a light-emitting diode (LED) 
6, a lens system 7, and a light-sensitive sensor 8, which 
constitutes the interface with the electronic circuitry 
part 4 . 

10 The task of the LED 6 is to illuminate a surface 

which is currently located under the window. A diffuser 
9 is mounted in front of the LED 6 for diffusing the 
light . 

The lens system 7 has the task of projecting an 
15 image of the surface located under the window 2 on the 
light-sensitive sensor 8 as accurately as possible. If 
the sensor 8 has a smaller light-sensitive area than the 
window 2, the lens system 7 is also required to reduce 
the image . 

20 In this example, the light-sensitive sensor 8 com- 

prises a two-dimensional, square CCD unit (CCD = charge 
coupled device) with a built-in A/D converter. Such sen- 
sors are commercially available. The sensor 8 is mounted 
at a small angle to the window 2 and on its own printed 

25 circuit board 11. 

The power supply to the device is obtained from a 
battery 12, which is mounted in a separate compartment 
13 in the casing. 

The block diagram in Fig. 2 schematically shows the 

30 electronic circuitry part 4. This is used, among other 
things, for processing the recorded images and thus is 
an example of how the image -processing means can be 
implemented. It comprises a processor 20, which by the 
intermediary of a bus 21 is connected to a ROM 22, in 

35 which the programs of the processor are stored, to a 
read/write memory 23, which constitutes the working 
memory of the processor and in which the images from the 
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sensor as well as identified and interpreted characters 
are stored, to a control logic unit 24, as well as to the 
sensor 8 and the LED 6. The control logic unit 24 is in 
turn connected to a number of peripheral units, compris- 
5 ing a display 25, which is mounted in the casing, an IR 
transceiver 2 6 for transferring information to/from an 
external computer, buttons 27, by means of which the user 
can control the device and specifically adjust the device 
between a first mode in which hand-written information is 

10 to be input, a second mode in which the device operates 
as a scanner, and a third mode in which the device ope- 
rates as a camera, a tracer LED 28 which' emits a light 
beam, making it easier for the user to know which infor- 
mation he is inputting, as well as an indicating device 

15 29, e.g. an LED, indicating when the pen is ready to 

record information. Control signals to the memories, the 
sensor, and the peripheral units are generated in the 
control logic unit 24 . The control logic also handles 
generation and priorit isat ion of interrupts to the pro- 

20 cessor. The buttons 27, the IR transceiver 26, the dis- 
play 25 and the tracer LED 28, and the LED 6 are accessed 
by the processor writing and reading in a register in the 
control logic unit. The buttons 27 generate interrupts to 
the processor 2 0 when they are activated. 

25 The operation of the device will now be described, 

presupposing that the user first wishes to input hand- 
written text . The user directs the device at a surface 
having some kind of pattern. For example, the surface can 
be a sheet of paper with text on it, a wall, or a bowl of 

30 sweets. He presses a button 27 to activate the device and 
subsequently "writes" the text he wishes to input with 
the device directed at the selected surface. The tracer 
LED 2 8 successively indicates the path of movement on the 
surface by means of a luminous spot to give the user an 

35 idea of the movement. When the user activates the pen, 
the processor 2 0 commands the LED 6 to begin generating 
strobe pulses at a predetermined frequency, suitably 
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about 2 5 Hz, whereupon the images recorded by the sensor 
are stored in the read/write memory 23. When the user has 
written the information he wishes to input, he releases 
the button 27, whereupon the processor 20 turns off the 
5 LED 6. The user can then control the device to show the 
inputted information on the display 25 or to transfer 
it to an external computer by the intermediary of the IR 
transceiver 26. The possibility of showing the scanned 
information directly on the display has proven very 

10 important since a user often wishes to verify that the 
correct information has been scanned. 

The flowchart in Fig. 3 shows in more detail how 
the device functions in connection with the inputting of 
hand-written information. In step 301, images with over- 

15 lapping contents are scanned while the device is being 
moved relative to the surface at which it is directed. 
The scanned images are stored in the read/write memory 
23. The images are stored as images, i.e. with the aid of 
a plurality of pixels, each having a grey scale value in 

2 0 a range from white to black. 

As soon as an image has been recorded, the process 
begins of determining how the current image and the pre- 
vious image overlap, step 302, i.e. in which relative 
position the best match is obtained between the contents 
25 of the images. For this purpose, every possible overlap 
position between the images is examined, at the pixel 
level, and an overlap measurement is determined as fol- 
lows : 

1) For each overlapping pixel position, the grey 

3 0 scale values of the two relevant pixels are added up if 

the latter are not white. Such a pixel position in which 
none of the pixels are white is designated a plus posi- 
tion. 

2) The grey scale sums for all the plus positions 
3 5 are added up. 

3) The neighbours of each pixel position are examin- 
ed. If an overlapping pixel position is not a neighbour 
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of a plus position and consists of a pixel which is white 
and a pixel position which is not white, the grey scale 
value of the non-white pixel is subtracted, possibly mul- 
tiplied by a constant, from the sum in point 2) . 
5 4) The overlap position providing the highest over- 

lap measurement as stated above is selected. In the 
resulting composite image the mean value of the grey 
scale value of the overlapping pixels is used. In this 
way, noise can be suppressed in the overlap area. The 

10 putting- together is thus carried out both vertically and 
horizontally. If it is detected that, when being put 
together, the images do not end up on a horizontal line, 
the composite image is suitably adjusted so that it 
becomes horizontal, for example by turning the composite 

15 image. 

Our Swedish Patent Application No. 9704924-1 and the 
corresponding US Application No. 024,641, describe an 
alternative way of matching the images in order to find 
the best overlap position. The content of these applica- 

20 tions is herewith incorporated by reference. 

When the relative position of the two images has 
been determined, the processor 20 determines a movement 
vector, in step 303, which indicates how far and in which 
direction the device has been moved between the recording 

25 of the images. The movement vector is stored in the memo- 
ry as part of a digital description of how the device has 
been moved. The processor also determines how the second 
image is turned in relation to the first one, i.e. how 
the device has been turned between the recording of the 

30 images. This is carried out by examining the overlap in 
different turning positions between the first and the 
second image. The turning is stored as a turning indica- 
tion in the memory and it, too, constitutes a part of the 
description of how the device has been moved. When this 

35 step has been completed, the first image is discarded and 
the second image becomes the first image, after which the 
putt ing- together of the subsequent scanned image with 
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this new first image is commenced. It should be pointed 
out that in most cases, movement vectors and turning 
indications need not be determined in a separate step but 
they can be obtained as a direct result of the determina- 
5 tion of the relative position of the images. As is evi- 
dent from that described above, steps 3 01-303 can proceed 
more or less in parallel. 

When the device detects that the inputting of an 
information unit is complete, for instance by the user 

10 releasing the button 2 7 or by the device not being moved 
for at least a predetermined period of time, the device 
decides whether or not the inputted information is to 
be interpreted, step 304. If the user has indicated by 
pressing a button that the inputted information is text 

15 information which is to be interpreted, the processor 20 
reads in the movement vectors in the description of the 
information unit in question to an ICR module which iden- 
tifies which character the movement vectors represent. 
Subsequently, the identified character is stored in char- 

2 0 acter- coded format in the memory. The interpreted charac- 

ter can be shown on the display 25 if the user indicates 
this preference by pressing a button. If the user has not 
indicated that the information is to be interpreted, no 
further action is taken with respect to the information 
25 unit and the device is ready to record further informa- 
tion units . 

Fig. 4 schematically shows how images with overlap- 
ping contents are recorded when a device as described 
above is directed at a sheet of paper and the device is 

3 0 moved in a path of movement forming the letter "R" . For 

the sake of simplicity, the contents of the images are 
not shown in Fig. 4. 

Fig. 5 shows how an inputted letter R can be repro- 
duced on the display of the device on the basis of the 
35 relative positions determined . by the device for the 

images in Fig. 4. Thus, in this case, the device shows 
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an "image" of the inputted character with the aid of the 
movement vectors, not an interpreted character. 

The above description outlines how the device can be 
used in a first mode for inputting hand-generated infor- 
5 mat ion. However, in a second mode, the device can also be 
used as a scanner, i.e. for scanning predefined text and 
image information on an information carrier. If the user 
wishes to use the device in this way, he indicates this 
by pressing a button in a suitable manner. 
10 Suppose now that the user wishes to scan text from a 

sheet of paper. In this case, the user directs the device 
at the sheet of paper with the text at the location where 
he wishes to begin recording a character sequence. He 
presses the button 27 to activate the pen and passes it 
15 over the text which is to be recorded, following the text 
in the same manner as when one reads the text. The tracer 
LED 28 emits a light beam which makes it easier to follow 
the lines. When the user activates the pen, the processor 
2 0 controls the LED 6 to scan images in the same way as 
20 described above with respect to inputting of hand-gene- 
rated information. When the user has passed the device 
over the selected text or has come to the end of a char- 
acter line, he lifts the pen off the sheet of paper and 
releases the activating button, whereupon the' processor 
2 5 2 0 turns off the LED 6. 

The flowchart in Fig. 6 illustrates in more detail 
how the device operates in this mode. In step 601, the 
images with overlapping contents are scanned and stored 
in the same way as in the first mode. 
30 In step 602, the best overlap position is determin- 

ed for each pair of images in the same way as described 
above for the first mode. In this position, the images 
are put together into a composite image comprising a plu- 
rality of characters, possibly a whole line. 
35 In step 603, the software of the processor 20 

divides the composite image into sub- images, each com- 
prising only one character. The purpose of this is to 
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create input signals to the OCR software which is to 
interpret the characters. The division is effected by 
adding up the grey scale values of the pixels for each 
pixel row and each pixel column in the composite image. 
5 By studying the local intensity minima for the row sums 
and column sums thus obtained, boundaries can be deter- 
mined for the extent of each character in the image. 

In step 604, each of the sub- images is scaled down 
to a predetermined pixel format by dividing the sub- image 

10 into groups of pixels, each of which is replaced by a 
pixel whose grey scale value corresponds to the mean 
value of the grey scale values of the pixels included in 
the group. If necessary, a like downscaling can be car- 
ried out between other steps of the method according to 

15 the invention. Further, the character is centred with 

respect to its point of balance and the grey scale values 
are normalised so that the sum of the square of the grey 
scale value of each pixel is given a fixed value. 



2 0 composite image of the character sequence recorded is 
interpreted. The grey scale values of the pixels which 
together constitute a sub- image containing only one char- 
acter are fed as input signals to an OCR software. In 
step 606, the identified character is stored using a 

2 5 predetermined character code format, for example ASCII 

code, in the read/write memory 2 3 in a memory area for 
interpreted characters. When the character identification 
and storing in character-coded format is completed, the 
processor activates the indicating device 2 9 to inform 

3 0 the user that it is ready to record a new character 

sequence, step 607. Subsequently, it goes back to step 
601 . 

The above steps in both the first and the second 
mode are thus carried out by the processor 2 0 with the 
35 aid of the associated units and suitable software. Such 
software can be created by the skilled person with the 



Subsequently, in step 605, each character in the 
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aid of the above instructions if it is not commercially 
available . 

Figs 7a-7e illustrate how the character sequence 
"Flygande backasiner" is scanned. Fig. 7a shows the text 
5 on a sheet of paper, which also has a certain amount of 
"dot noise" in the form of small black spots. Fig. 7b 
shows the images which are being recorded with the aid of 
the sensor. As can be seen from this figure, the contents 
of the images partially overlap. For example, the letter 

10 1 appears completely in image No. 1 and partially in 
image No. 2. The degree of overlapping depends on the 
traction speed, i.e. the speed with which the user pulls 
the device over the text in relation to the frequency 
with which the contents of the sensor are read out . 

15 Fig. .7c shows what the whole composite image looks like. 
It should be noted that the image is still stored in the 
form of pixels. Fig. 7d illustrates the division of the 
composite image into sub- images. Fig. 7e shows the scaled 
and normalised letters which are used as input signals to 

2 0 the neural network. When the method has been carried out; 
the text "Flygande backasiner" is stored in the read/ 
write memory of the device as ASCII code. 

As stated above, the device can also be used in a 
third mode, the camera mode, for recording images of 

25 objects which are located at a distance from the device . 
In order to effect sharp imaging at various distances, 
the lens system 7 can be adjustable between two fixed 
positions, one being used in the scanner mode and the 
other in the camera mode. Alternatively, the position of 

30 the lens system 7 can be slidably adjustable for provid- 
ing an autofocus function. The adjustment of the lens 
system can be effected by means of the same technique as 
is used in cameras. 
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CLAIMS 

1. A device for recording hand-written information 
5 in the form of characters, symbols, graphs, drawings, 

calligraphy and similar hand-written information defined 
by a hand movement, comprising recording means (3) which 
are adapted to be moved by a hand which carries out the 
hand movement and to record a plurality of images with 

10 partially overlapping contents while the recording means 
are being moved, characterised in that the 
device further comprises image-processing means (4) which 
are adapted to determine the relative position of the 
images with the aid of the partially overlapping contents 

15 for providing a description in digital format of how the 
recording means have been moved and, in this way, a digi- 
tal representation of the hand-written information. 

2. A device according to claim 1, wherein the device 
is adapted to store said description in digital format. 

20 3. A device according to claim 1 or 2 , wherein said 

description comprises a plurality of movement vectors 
each indicating how the recording means have been moved 
between the recording of two images. 

4. A device according to claim 1, 2 or 3 , wherein 
25 said description comprises turning indications, each 

indicating how the recording means have been turned 
between the recording of two. images. 

5 . A device according to any one of the preceding 
claims, wherein said device is adapted to determine, 

30 on the basis of the overlapping contents of the images, 
the speed at which the recording means have been moved 
between the recording of two images. 

6. A device according to claim 5, wherein said 
device is adapted to compare the speed with pre-recorded 

35 speed data for checking the authenticity of the inputted 
information. 
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7 . A device according to any one of the preceding 
claims, wherein the hand-written information comprises 
characters and wherein the image-processing means are 
further adapted to identify the characters with the aid 
5 of the description in digital format and to store the 
identified characters in character-coded format. 

8 . A device according to any one of the preceding 
claims, wherein said device has a light-sensitive sensor 
means (8) with a two-dimensional sensor surface for 
10 recording the images. 

9 . A device according to any one of the preceding 
claims, wherein said image-processing means are adapted 
to determine the relative position of the images both 
horizontally and vertically. 
15 10. A device according to any one of the preceding 

claims, wherein the recording means are adapted to be 
directed, while being moved, at a surface which is imaged 
with the aid of said plurality of images . 

11. A device according to any one of the preceding 

2 0 claims, further comprising tracing means (28) for indi- 

cating on the surface the movement of the recording 
means . 

12. A device according to claim 11, wherein the 
tracing means (28) comprise an illumination means which 

25 projects light onto the surface. 

13 . A device according to any one of the preceding 
claims, wherein the recording means and the image-pro- 
cessing means are arranged in a common casing (1) which 
is adapted to be moved by the hand carrying out the hand 

- 3 0 movement . 

14. A device according to any one of claims 1-12, 
wherein the recording means are arranged in a first cas- 
ing and the image-processing means in a second casing. 

15. A device according to any one of the preceding 

3 5 claims, wherein the image -processing means comprise a 

processor (20) . 
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16. A device according to any one of the preceding 
claims, wherein said device is adjustable to an opera- 
tional mode in which it is adapted to record predefined 
information, preferably text, located on an information 

5 carrier, by imaging the information with the aid of a 

plurality of images with partially overlapping contents. 

17. A device according to any one of the preceding 
claims, wherein said device is adjustable to an opera- 
tional mode in which it is adapted to image an object 

10 located at a distance from the device. 

18. A device according to any one of the preceding 
claims, further comprising a transceiver (26) for wire- 
less communication with an external unit. 

19. A method of recording hand-written information 
15 in the form of characters, symbols, graphs, drawings, 

calligraphy and similar hand-written information defined 
by a hand movement, comprising the steps of 

- moving a device with a hand which is carrying out 
the hand movement; 

20 - recording a plurality of images with overlapping 

contents while moving the device; and 

- determining the relative position of the images 
with the aid of the partially overlapping contents for 
providing a description in digital format of how the 

25 device has been moved and, in this way, a digital repre- 
sentation of the hand-written information. 

20. A method according to claim 19, wherein the 
information defined by a hand movement comprises charac- 
ters and further comprising the steps of identifying the 

3 0 characters with the aid of the description and storing 
them in character-coded digital format. 

21. A method of determining the position of a hand- 
held device which is adapted to record a plurality of 
images while it is being moved, characterised 

35 in that the images are recorded with partially overlap- 
ping contents which are used for determining the position 
of the device. 
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